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Abstract — The problem of broadcasting a pair of correlated 
Gaussian sources using optimal separate source and channel 
codes is studied. Considerable performance gains over previously 
known separate source-channel schemes are observed. Although 
source-channel separation yields suboptimal performance in gen- 
eral, it is shown that the proposed scheme is very competitive for 
any bandwidth compression/expansion scenarios. In particular, 
for a high channel SNR scenario, it can be shown to achieve 
optimal power-distortion tradeoff. 

I. Introduction 

Consider the problem of transmitting two correlated Gaus- 
sian sources over a Gaussian broadcast channel with two 
receivers, each of which desires only to recover one of the 
sources. In Q], it was proven that analog (uncoded) transmis- 
sion, the simplest possible scheme, is actually optimal when 
the signal-to-noise ratio (SNR) is below a threshold for the 
case of matched source and channel bandwidth. To solve the 
problem for other cases, various hybrid digital/analog (HDA) 
schemes have been proposed in Q, (3), 2), and (5). In 
fact, the HDA scheme in [5| achieves optimal performance 
for matched bandwidth whenever pure analog transmission 
does not, thereby leading to a complete characterization of 
the achievable power-distortion tradeoff. For the bandwidth- 
mismatch case, the HDA schemes proposed in [3| and |4| 
comprise of different combinations of previous schemes using 
either superposition or dirty-paper coding. 

In all the aforementioned work, authors also compared 
achieved performances with that of separate source-channel 
coding. Since the channel is degraded, source coding boils 
down to sending a "common" message to both decoders and 
a "refinement" message to the decoder at the end of the better 
channel. In both of the two source coding schemes proposed 
in @, the first source is encoded as the common message, but 
one scheme encodes (as the refinement message) the second 
source independently, and the other after de-correlating it with 
the first source. In 0, on the other hand, the second source is 
encoded after it is de-correlated with the reconstruction of the 
first source. Although this approach provably yields a better 
performance than the schemes in [2|, it is still not optimal. 
In H, it was shown that the optimal rate-distortion (RD) 
tradeoff in this source coding scenario is in fact achieved by a 
scheme called successive coding, whereby both common and 
refinement messages are generated by encoding both sources 
jointly, instead of using any kind of de-correlation. Although 
successive coding is a special case of successive refinement 



in its general sense, computation of the RD tradeoff, even 
for Gaussians, turned out to be non-trivial. A Shannon-type 
lower bound derived for the problem was rigorously shown 
to be tight, yielding an analytical characterization of the RD 
tradeoff. 

In this paper, we investigate the performance of sepa- 
rate source and channel coding for any bandwidth compres- 
sion/expansion ratio. As discussed in the previous paragraph, 
the source coding method to be used for optimal performance 
is successive coding. We first show that this separate coding 
scheme achieves the optimal power-distortion tradeoff when 
one receiver requires almost lossless recovery, and the other 
requires a small enough distortion. Comparing with best- 
known schemes and outer bounds, we then show that this 
scheme is competitive in other cases as well. Our results imply 
that with a (sometimes marginal) sacrifice of power-distortion 
performance, we can design separate source and channel 
codes, and thus enjoy the advantages such as simple extension 
to different bandwidth compression/expansion ratios. 

In Section II, the problem is formally defined. Our main 
results are proved in Section III and the separate coding 
scheme is compared with other separation-based schemes and 
hybrid schemes in Section IV. 

II. Preliminaries 
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Fig. 1, System model. 

As depicted in Fig. Q] a pair of correlated Gaussian sources 
(SijS*) are broadcast to two receivers, and receiver i, i G 
{1, 2}, is only to reconstruct 5f . Without loss of generality, we 
assume the source sequences are generated in an i.i.d. fashion 

by PSiS 2 = -Af(0, C), where 

' 1 P 
P 1 

and p G [0,1]. The transmitter encodes the source sequences 
to U n and thus can be described mathematically as U n = 



ip(S k , S 2 ). We define bandwidth compression/expansion ratio Si. The resultant distortion region becomes 



K = ? with the unit of channel uses per source symbol. 

The channel also has an average input power constraint, 
given by 



1 



3=1 

At receiver i, U n is corrupted by i.i.d. additive Gaussian noise 
W™, which satisfies Wi ~ Af(0,Ni), where we assume that 
N\ > N 2 . The channel output V™ is then a Gaussian sequence 
given by Vi(j) = U(j) + Wi{j). Decoder 1 reconstructs 
S k from the channel output V™ and can be described as a 
function S k = <fii(V™). Analogously, decoder 2 computes 
§2 = 4>2(V 2 n )- The reconstruction quality is measured with 
squared-error distortion, i.e., 



3 = 1 



S3)" 



for any source block s k and reconstruction block s k . The 
problem is to find the optimal tradeoff between the channel 
input power constraint P and the expected distortion pair 
(-Di,Z)2) achieved at the receivers. 

In (2), an outer bound to the distortion region is obtained for 
n = 1 by assuming full knowledge of Si at the second (strong) 
receiver. In that outer bound is extended to bandwidth- 
mismatched case, in the form of 
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D, >,l-/r.(l + ^ 



(1) 

(2) 



where 7/ G [0, 1] and 77 = 1 — rj. 

Several separation-based schemes have been previously 
proposed, differing only in their source coding strategy. In 
the first separation-based scheme, termed Scheme A in J2], 
sources Si and S2 are encoded as if they are independent, 
resulting in the distortion region given by 



Di > 1 



T]P 



D 2 > 1 + -b- 



f]P + Ni 
fjP 

In Scheme B in [2], the second source is written as S 2 — 
pSi + E, where Si _L E, and S\ and E are treated as two 
new independent sources. Hence we obtain 



£>i > 1 



T]P 



fjP + Ni 



D 2 >(1- p 2 ) 



1 



fjP 
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In the scheme introduced in [5|, which we call Scheme C, 
Si is quantized to Si and 5*2 is then encoded conditioned on 



Di> 1 



i]P 



fjP + Ni 



D 2 > [1-^(1-^)] 1 



fjP 
N2~ 



(3) 
(4) 



Of the three, it is obvious that Scheme C achieves the best 
performance. However, it is still not optimal as we will show 
in Section IV. The optimal strategy is in fact what is called 
successive coding in J6], whereby the sources are encoded 
jointly at both the common and the refinement layers. The 
RD tradeoff for successive coding of Gaussian sources with 
squared-error distortion was given in []6] parametrically with 
respect to a G [0, 1] a£] 

* l(a) = \ log Di(i-X)-( P -,sy 



1, 1 - v* 
— log 

2 & D 2 



where 5 = 1 — Di, [x] + = ma,x{x, 0}, and 



with v* = 



i-D 2 



if D 2 < 1 - v%6 

if 1 - v%5 < D 2 < 1 - p 2 S 

and fo is the unique root of 



f a {v) = (1 - a)(p - v5){l - vp) - a{v - p)(l - v 2 5) 
in the interval [p, min(^, |)]. 

III. Main Results 

We first show the RD region of successive coding can be 
simplified by eliminating both the parameter a and the need 
to find the roots of the cubic polynomial f a (y). 

Lemma 1: The achievable source coding rate pair (Ri,R 2 ), 
for any distortion pair (Di,D 2 ), is given by 

„2 

(5) 



Rl[u) = \ l0g Di{l-X)~(p- v 8y 



l 



■lot 



l-u 2 5 
D 2 



(6) 



where v G p,min(i, f , v*) 

The proof is deferred to Appendix A. 

In separate coding, the region of all achievable (P, Di,D 2 ) 
triplets can be determined using one of two methods. The 
conventional method fixes P and searches for the lower 
envelope of all (Di,D 2 ) whose source rate region intersects 
with the capacity region given in Q. Alternatively, we can fix 
(£>i, D 2 ) and search for the minimum P whose corresponding 
capacity region intersects with the source rate region given in 
Lemma 1. We find this alternative both more convenient and 
more meaningful. More specifically, it is easier to compare 

'When Dz > 1— p 2 (l — -Di), the optimal strategy degenerates into sending 
only a common message and estimating 5| solely from 5*. So this trivial 
case is excluded from the discussion in the sequel. 



schemes based on the minimum power they need to achieve 
the same distortion pair, and the ratio of minimum powers 
yields a single number as a quality measure. 

To be able to use this alternative, first we need to find out 
the minimum required power for any given source coding rate 
pair (i?i,i? 2 ). 

Lemma 2: For any source coding rate pair (Ri,R 2 ), the 
minimal required power is given by 



P{R u R 2 ) = N l 2 



>2fli/ K 



- 1 



N 2 



(7) 

Proof: For a Gaussian broadcast channel where the better 
receiver is the second one, R\ > and R 2 > 0, rates of 
common and private information, respectively, can be achieved 
if and only if there exists < rj < 1 such that 



Ri < 2 lo S 
R2 < I log 



1 



1 



fjP 
fjP 
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where 77 = 1 — rj. This, in turn, implies that P is achievable 
if and only if there exists < fj < 2~ 2Rl / K such that 



P > max 



Nl (2 2 «i/- - 1) N 2 (2 2R ^ K - 1) 
1 - f)2 2R ^ K ' fj 



Since the terms in the maximum exhibit opposite monotonicity 
with respect to fj with asymptotes at fj = and fj — 2~ 2Rl / K , 
the minimum power is achieved when the two terms are equal, 
that is, when 



V 



N 2 (2 



1) 



jV 1 (2 2fl i/« - 1) + N 2 (2 2R ^ K - l)2 2i? i/ K ' 

and has the form in (0. ■ 
By substituting <(5j and © into (0, we obtain the minimum 
power required for the separate coding scheme as a function 
of v. 



P(y) = Nx 



-No 



l-p 2 



Do 



Di(l 

1/k 



u 2 5) - (p - v5) 2 



1/k 



- 1 



I-P 2 



Di(l-v 2 5)-(p-vSy 



solely from (Q]l, whereas when D 2 < 1 — p 2 , the minimum 
power satisfies equality in both (fl3 and Combining the 
two cases, we obtain the concise expression 



P 



outer bound 



NoD- 



-1/k 



-1/k 



1 



l-p 2 

On the other hand, from (|8), we have 



Ni(d; 



1/k 



1) 



p( P ) = n 2 d; 



1/k 



Do 



l-p 2 5 



-1/k 



- 1 



■Ni(Dl 1/K -1) 



Since 6 = 1 — D\, it is easy to see that when D 2 < 1 — p 2 



P(P) 



1 as L>i 



outer bound 



and since v = p is feasible, the minimum power of separate 
coding satisfies P scp < P(p). Therefore the performance of 
separate coding scheme approaches the outer bound, or 



outer bound 



when D 2 < 1 — p" and D\ 



. 



Similarly, by setting v = 4, we have 




0, 



1. Note when 



For bandwidth-matched case, the minimum power of sepa- 
rate coding P scp = min„ P{v) can actually be found analyti- 
cally for any (D±, D 2 ). We omit the details here. 

The following theorem is our first main result. 

Theorem 1: Separate source-channel coding achieves opti- 
mal power-distortion tradeoff when (Di,D 2 ) satisfies either 
of the following conditions 

1) D 1 -> and D 2 < 1 - p 2 , 

2) D 2 -> and D x < 1 - p 2 . 

Proof: We first find the minimum power the outer bound 
([l} and (fJli requires. Note that when D 2 > l-p 2 , © will hold 
for any rj € [0, 1], and hence the minimum power is obtained 



and when D 2 - 

D 2 ) > p 2 , min (i, | , v*^j = |, which again implies F scp < 
P{j), thus proving the second part of the theorem. ■ 
Remark 1: Here we proved that the outer bound is tight in 
1 i/k the region of (1 — D\)(l — D 2 ) > p 2 when either D\ or D 2 
goes to 0, and the performance of separate coding approaches 
the outer bound. The condition that either D\ or D 2 goes to 
(8)0 translates to infinite channel SNR. 

In fact, as we show in the following theorem, separate 
coding is approximately optimal for the entire region (1 — 
-Di)(l— D 2 ) > p 2 , in the sense that the power ratio p — — - 
can be upper-bounded universally in (Ni, N 2 ,Di, D 2 \ 
Theorem 2: When (1 - - D 2 ) > p 2 , 



scp 



< min 



outer bound 




Proof: The first half is true because 



10I<*>oteWi = 1, JVj = 0.5, p = 0.8, fs= 0.3 



P 



scp 



p. 
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P(P) 



outer bound 



P 



outer bound 



< 



Ni 


(1 - p 2 S) 1 / K - dI /k 




- d\ /k ) 


N 2 
Ni 

(1- 


(i - (P-yi* - d\ /k 
?S)V" - (dm 1 / 


K 


- d\ /k ) 



(1 - p 2)l/« _ (£, 1jD2 )1/« 
(c) (I - (1 -p) 2 /" 

" (1 -p2)l/« _ (1 -p)2/K 
W (l +/ ,)l/»[(l+ p 2)l/"-l] 
" + (l + / ,)l/»._(l_p)l/ic ' 

where (a) follows since /y = p is feasible, (6) by < 1, (c) 
follows since D\D 2 < (1 — p) 2 , and (rf) since 5 > p 2 . 

By relaxing P sop to P tne secon d half of the bound 

can be obtained in a similar way. The detailed proof is omitted 
here due to lack of space. ■ 

IV. Performance comparison 

A. Separation-based schemes 

As illustrated in J5] for k = 1, the outer bound in (Q~|i and 
(O is not always tight. Nevertheless, we can still compare 
P scp and P ou tor bound for any (Di,D 2 ), which provides an 
upper bound to the ratio of the minimum separate and joint 
coding power levels. To show the optimality of our separate 
coding scheme, we also compare our scheme with Scheme 
C, which provides the best performance among the three 
separation-based schemes mentioned earlier. The minimum 
required power of Scheme C can be obtained from (0 and 
© as 



Pc 



N 2 D 1 



-l/re 



Do 



1- P 2 8 



-1/k 



1 



Ni(Dl 



1 



Note that Pc = P(p) in the non-trivial distortion regions, 
so it is immediately clear that the successive coding scheme 
outperforms Scheme C. 

As an example with bandwidth compression, we show the 
power ratio between our separate coding scheme and the 



outer bound in Figure |2Ua)| and that between Scheme C and 



our separate coding scheme in Figure |2 |ib)| both in dB. For 
reference, the black curves illustrate the different distortion 
regions for a related problem in [8|, where only one receiver 
is in presence and interested in reconstructing both sources. 
The lower left corner region is actually (1 — Pi)(l — D 2 ) > p 2 , 
where, in general, small dB differences are observed, as 
implied by the two theorems above. As can be seen from 
the figure, even for highly correlated sources, the optimum 
separate coding scheme does not require too much extra power 
in most of the (Pi,£>2) plane. Again, since the outer bound 
is not always tight, the large power difference in some regions 
may be dramatically reduced when the outer bound is replaced 
by the optimum performance. For smaller p values, we observe 
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(a) Power difference between separate coding and the outer bound. 

101og lo7 Jt. Ni = 1, « 2 = 0.5, p = 0.8. k= 0.3 
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(b) Power difference between Scheme C and optimal separate coding. 

Fig. 2. Comparison between the power of outer bound, Scheme C and 
optimal separate coding, p = 0.8, A?i = 1, ./V2 = 0.5 and ft = 0.3. 



that the power difference is very small in the entire plane, as an 
example illustrates in the next section. This is a natural result 
because separate coding is optimal for independent sources 
and small p value means the sources are not highly dependent. 

There is also noticeable power difference between our 
scheme and Scheme C, and we numerically observe large dB 
values near the point Di = 1 — p 2 and D 2 = 0, for which we 
can obtain analytically the power ratio. 



Theorem 3: When D\ = \ — p and D 2 



0, 



Pc 
p 

J- son 



The proof uses the fact that the power of our separate coding 
scheme goes to that of the outer bound when approaching this 



point. 

When the two receivers have the same noise level, i.e., N\ = 
N2, it can be shown that our separate coding scheme achieves 
the corresponding rate-distortion function R(Di,D2) in JS), 
whereas none of the three separate coding schemes mentioned 
earlier has the same performance. 

B. Hybrid Digital/ Analog (HDA) schemes 

P = 1.995 N = 1 N = 0.3162 p = 0.2 k = 2 




(a) p = 0.2 

P = 1.995 N = 1 N = 0.3162 p = 0.8 k = 2 




(b) p = 0.8 

Fig. 3. Comparison between outer bound, RFZ scheme in [4] and separate 
coding. P = 3dB = 1.995, iVi = OdB = 1, N 2 = -5dB = 0.3162 and 
k = 2. 

In and H, a group of hybrid digital/analog (HDA) 
schemes were proposed for bandwidth-mismatched case, 
where analog, digital, and hybrid schemes are layered with 
superposition or dirty-paper-coding. The achievable distortion 
region can be found by varying power allocation and scaling 
coefficients. In [4], an HDA scheme from [9] for broadcasting 
a common source with bandwidth expansion was adapted for 
the problem of broadcasting correlated sources and is termed 



the RFZ scheme. In addition, a scheme, termed the HWZ 
scheme, containing an analog layer and two digital layers 
each with a Wyner-Ziv coder and a channel coder, was also 
proposed. It is argued by an example in ||4] that the HWZ 
scheme performs similar to the RFZ scheme. Here we compare 
our separate coding scheme with the outer bound and the 
RFZ/HWZ scheme in Figure [30 For this comparison, we 
revert to the more familiar (Di,Z?2) plot for the exact same 
(P, p, k, N\,N2) as those used in the examples in J4). 



As seen in Figure | 3j[a)| when p is small, the separate coding 
scheme almost coincides with the outer bound and outperforms 
RFZ/HWZ schemes. When the sources are highly correlated 
as in Figure |2 }{b)| the separate coding scheme is still better 
than the RFZ/HWZ schemes when D2 is lower than a certain 
value, and also provides competitive performance when it is 
higher. We observed similar performance behavior when we 
compared the separate coding scheme to the layered schemes 
in |fj) for bandwidth compression. 

V. Conclusion 

The performance of optimum separate source-channel cod- 
ing scheme for broadcasting two correlated Gaussians is ana- 
lyzed. The minimum power required for a given distortion pair 
is used as a tool to compare performances of different schemes. 
It is illustrated that this separate coding scheme outperforms 
other known separate schemes, and is competitive in general 
in the sense that its minimum required power is close to 
the power implied by the outer bound. Also, in a certain 
"low distortion" region, the power difference is analytically 
bounded. In fact, within this region, in the extreme cases of 
almost lossless reconstruction of either source, the separate 
scheme is provably optimal. 

Appendix A 
Proof of Lemma 1 

The cubic function in (6) is 

/» - (i - n)(p - uS)(i - up) - niy - P )(i - vH) 

and when f n (v) = 0, it can be re-written as 

= {P~v5)(l - vp) 

V u[l- p 2 -5{l-2vp + v 2 )] ' 

It will be shown that varying rj in [0, 1] is equivalent with 

, by showing rj is a 



p,min(i £ 



i--D 2 



varying v in H ,^ y -,j,y — 

monotonically decreasing function of v. 

When <5>p 2 , / o<|<i and also note r\ = 1 and when 
v = p and j, respectively. We examine 



h{v) = 



p — vS 



instead of 77, and 

dh 
dp 



1 - p 2 -5(1 - 2vp + v 2 ) 
oc -1 - p 2 + 5 + 2vp - v 2 8 . 



2 The performance of RFZ is plotted to represent both schemes as their 
curves almost coincide at least for this set of parameters in [4|. 



The right hand side is a quadratic function of v centered at 

2 

v = I and the maximum value is —(1 — S)(l — ^-) < 0. 
(When v = p, the function value is— (1 — p 2 )(l — S).) 

Similarly, when S < p 2 , we have p < - p < | and in this 
case, 7] = 1 and when v = p and -k We examine 



v 7 1 - p 2 - S(l - 2up + v 2 ) ' 

and thus have 

^ oc -p(l - p 2 ) - p5 + 2vb - v 2 pb . 

The right hand side is centered at v = ^ and the maximum 
value is -(1 - p 2 )(p - ^) < 0. ■ 
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